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Dep/^rtmbnt of Education 



State of Florida 



FI.OYD T. CHRISTIAN 
COMMISSIONER 



TALLAHASSEE 32304 



February 23 , 1971 



Dr. Leon M. Lessinger 
Chairman, Board of Governors 
Educational Research and Development 
Georgia State University 
33 Gilmer Street, S.E. 

Atlanta, Georgia 30303 

Dear Dr. Lessinger: 

I have received and reviewed the Second Annual Report of the Florida Educational 
Research and Development Program ^^hich was submitted to me by the Board of Gover- 
nors for Educational Research and Development. I am extremely pleased wit^i the 
report and endorse its contents fully. 

You have presented clearly the challenge v^hic i faces Florida education as we move 
to increase the effectiveness of our programs , while attempt^g to operate w'ithin 
tight budgets, 'fhe ex^jectations of increased productivity, increased accountabil- 
ity, and continuing self-renewal which you describe in Chapter 4 are goals which 
I feel must become realities. For this reason, I am pledging the support of the 
Department of Education in meeting the targets which you specify on pages 18 and 



Improved educational management techniques by the end of 1972. 

A restructure of teacher training by the end of 1974. 

Mastery of basic skills by every child enrolled in elementary school 
by the end of 1976. 

The State of Florida is greatly iridebted to the members of the Board of Governors 
for your work in behalf of our Educational Research and Development Program. 
Please accept this expression of gratitude for your services. 



19: 




Sincerely 



ERIC 
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GEORGIA STATE UNIVERSITY 

33 3ILMER STREET. S. E. • ATLANTA. GEORGIA 30303 



February 15, 1971 



Honorable Floyd T. Christian 
Coninissioner of Education 
State of Florida 
Tallahassee, Florida 32304 

Dear Commissioner Christian: 

I am transmitting herewith the Second Annual Report of the Elorida Educational 
Research and Development Program. This report was prepared in accordance with 
the requirements of Section 229.561(2) (b) 12, Florida Statutes. It was compiled 
by TTioinbors o£ tho staff of tho Dopartmont of Education who wore assigned to as- 
sist the Board of Governors in this task. 

Florida's Research and Development Program represents a pioneering effort. _ It 
brings a no-monsenise businesslike approach to educational improvement within 
the context of a resnonsive and humane concern for both the student and the tax- 
payer. 

The Department of Education relies heavily on a carefully selected group of ad- 
visers from both outside and inside the State. The Board of Governors consists 
of persons with national expertise and experience in both research and develop- 
ment who have directed national programs of educational innovations with work 
done in schools, research laboratories, and _ industry. All nresently wr; in 
classrooms, in supervising innovations, or r capacities. Ra- 

vi ze from ; ithin the State is provided by a well-chosen, representative group 
of Floridians, the Advisory Council. The Council presents recoimiendations 
regularly to the Board both in writing and in person. 

The Board has emphasized assessmei t oh the present si-^ation in Florida Educa- 
bion to obtain feedback and guic'ance for future activities. There been and 
continues to be careful planning Bepu commitments to honest and effective re- 
porting on the achievements, needs, and possibilities for educational improve- 
ments in the State have been made. The Board_ believes in a broad spectrum of 
educational improvements with no particular biases. The members have demon 
strated diverse and balanced interests . 

The Board wishes to commend you and your staff for your efforts to make the Edu- 
cational Research and Development Program a success. To our knowledge, this if: tne 
only program of its type in the ciauntry~, and should certainly be a model for 
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Honorable Floyd T. Christian 
February 23, 1971 
Page 2 



other states. We are convinced that your R § D efforts will bring about far 
reaching changes in Florida's educational Systran. These changes should result 
in a more productive educational system: a system in which eveiy pupil masters 

the skills required to be a productive member of society. 



Sincerely , 




Leon M. Lessinger 

Chairman, Board of Governors for Educational 
Research and Development 



LML:dh 



ERIC 
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THE FLORIDA EDUCATIONAL RESEARCH AND DEVELOPMENT PROGRAM 
ADVISORY COUNCIL - 1970-71* 



Classroom Teachers: 



Principals : 



Miss Charlotte Spungin - South Broward High School 
Mr. Lindsey Morris ~ Bonner Elementary School j Daytona Beach 
Lou Graves " Pinellas Central Elementary School 

Mr. George Bowker - Kelsey L. Pharr Elementary School, Miami 
Mr. Glynn Archer, Jr. - Key West High School 



Superintendents and 
Supervisors ; 

School Board: 
County Consortia: 

High-r Education: 

Junior College: 



Dr. James Longstreth - Charlotte County Schools 
Dr. Donald Johnson - Duval County Schools 
Dr. William Byrd - Dade County Schools 

Mr. William Woodbury - Florida School Boards Association 

Mr. Shouppe Howell - Panhandle Area Educational Cooperative 
Dr. J. B. White - Florida Educational Research and 
Development Coi.incil 

Dr . Robert Morgan CGii^itman} ~ Florida State University 
Dr. Richard P. Toister - University of Miami 
Dr. Evelyn Martin ~ Florida A § M University 

Dr. Robert McCabe - Miami-Dade Junior College 



Vocational -Technical -Adult 
Education: 

Professional Association: 
Non-Public Education: 
Laymen: 



Students : 



Mr. Cliff A. Bellimi - Sarasota County Schools 

Mr. Arthur Hays - Florida Education Association 

Father Jerome Diffley - Diocese of St. Petersburg 

Mr. Bruce Culpepper, Attorney - Tallahassee, JFlori^ 

Mrs. Frances Deen, Executive Committee , Florida Public 
School Advisory Council, Tampa, Florida 
Dr. Simon Boyd, Doctor of Dental Surgery - Pensacola, Florida 

Mr. William S. Comegys, President, Student FEA 
St. Petersburg Beach, Florida 
Miss Rita Farabee, Governor Girls State - Miami 
Springs, Florida 

Mr. John L. Dicks, Governor Boys State - Plant 
City, Florida 



* Advisory Council members are appointed for a texm of one year. 
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THE FLORIDA EDUCATIONAL RESEARCH AND DEVELOMM" PROGRAM 



BOARD OF GOVERNORS - 1970-71 

Dr. R. L. Bright, PTOfessor and Assistant to the President, Baylor University, 
Waco, Texas (1971)’' 

Dr. John K. Coster, Director, Center for Occupational Education, North 
Carolina State l&iiversity, Raleigh, North Carolina (19 ^ 2)* 



Dr. Robert M. Gagne, Professor of Educational Research, Florida State University, 
Tallahassee, Florida (1973)* 



Miss Barbara Goleman, Classroom Teacher, Miam). Jackson Senior High School, Miami, 
Florida (1973)* 



Dr. Leon M. Lessinger, Callaway Professor of Education and Professor of Urb^ LjJe 
Georgia State University, Atlanta, Georgia, (Chairman, Board of Governors) (1971) 



Dr. T. E. Smothen.ian, Volusia County School Board Member, Professor of Educational 
Psychology, Stetson University, DeLand, Florida (1973)* 



Dr. J. Lloyd Trump, Associate Secretai^ for Research and Development, National 
Association of Secondary School Principals, Washington, D.C. (1971)* 



Dr. Herbert Wey, President, Appalachian State University, Boone, North Carolina 
(1972)* 

* The term of each member expires on June 30 of the year in parenthesis. 
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CHAPTER I 

A NEW STATE STRATECf FOR IMPROVING EDUCATION 



The people o£ Florida are vitally concerned about education. This concern is 
reflected by the Florida Legislature as it invests the citizens’ taxes m edu- 
cation and as it passes laws regulating education. The State investment in 
education currently conprises approximately 75% of trie eeneral revenue funds 
appropriated by the Legislature --43% of all State revenue. 

The State investment in Florida’s public education programs has increased sig- 
nificantly in recent years. As a result, educational programs have imp^ved 
S boS s?ope and quality. Nevertheless, there is a feeling on the part of 
many that increases in the magnitude of ^e educational mwstm^t a^ 
resulting in proportional increases in educational benefits. Stated differenay, 
SI eSitSiEns which the public hoi. 3 for education- to help alleviate social 
probl^ as well as intellectual problems --apparently are not being meu, even 
though the State is spending more money for education. 

As a result the Legislature and the executive branch of government are modi- 
fying the approach to supporting and regulating education. In the fm^emg 
of education a fundamental change can be seen. Lesser proportions of S^te 
funds for the operation of school programs are being appropriated in 
categories of expenditures- -such as textbooks, teachers salaries, or transpor 
tat ion. Increases in support are coming in categories such as other current 
expenses" or "educational improvement expenses". In the area of legislative 
SSion- the trend is away from detailed specification of personnel or pro - 
arfrieouirements and toward a system for making educators accountable for 
?elultsVich tLir pragrams achieve. New legislation requiring the assessment 
of vocational education and general education progr^s are / 

loveiraient -represent a new strategy for improving 

stated, the new strategy is to provide greater flexibility to 

educational programs and, at the same time, make them accountable for the results, 

Nati’rally, the effects of this new strategy have rippled through ^e education 
community. Teachers and other school officios welcome greater flexibility. 
Furtheimore, they are willing to be accountable. However, they do not feel 
that present methods for assessing pupil growth or for assessing teacher per- 
foitnance are adequate accountability measures. 

In order for the new State strategy for proving 533 ^^ 

be necessary to devise techniques of implementation. It will be neces ^ 
invent or Sscover adequate techniques for measuring the 33 ^" 

cational programs. It will also be necessary to discover or invent policies 
and procedures which could be considered as alternatives to present practices. 



Another facet of the new State strategy is represented in a program of educa- 
tional research and development. Funds for this program are appropriated 
separately from funds for operating instructional programs. These funds are 
now being used to develop techniques for assessing the results of educational 
programs, the costs of educational programs, and the utilization of educational 
resources. The funds are also being used to identify or develop alternative 
educational policies and practices. Hence, there is a program underway to 
develop improved techniques for educational accountability and to identify 
alternatives for making education more effective. 

The Florida Educational Research and Development Program was created in 1969 
by the Florida Legislature. A copy of the statute creating the program is 
included in Appendix A. The year 1969-70 was a planning year. A description 
of the activities during that year can be found in the First Annual Report of 
the Florida Educational Research and Development Program which was submitted 
to the State Board of Education and the Florida Legislature on February 23, 

1970. These activities are sxjmmarized in Appendix B of the present report.. 

The remainder of the present report describes the efforts now underway through 
the Educational Research and Development Program to implement the new State 
strF-tegy of reducing restrictions on local or institutional officials and at 
the same time holding them accountable for the effectiveness of their programs. 

As implied above, the R 6 D Program has two major conponents: (1) the develop- 

ment of techniques for monitoring educational results, costs, and resource 
utilization, and (2j the identification of alternative educational policies 
and practices. Chapters II and III take these two major conponents and develop 
them in more detail. Appendix D contains descriptions of individual projects 
which are now underway. Chapter IV synthesizes the information presented through.- 
out the report and established specific goals or targets for the future* 



CHAPTER II 



PFVFTnPTMr: TECHNIQUES FOR ASSESSING EDUCATIONAL RESULTS, 
COSTS, AND RESOURCE UTILIZATION 



The Florida Educational Research and Development Program created to sensor 
^ s*tudies or proiccts i^ixch seek infoTmation on questions o£ critical con 
cern to present and future educational needs of this State.” There is no 
question of more critical concern than, "How effective are educational programs 
in Florida?” This question is a vital one to professional educators, to ©du- 
cat ional policy m'^kers and to the general public. Persons concerns with educa- 
tional programs at the state level, the district level, the school , 

thrSalsrSLi level regard the question as critical. Without infoimation on the 
effectiveness of school programs, it is difficult to know where to start in 
trying to irnprove them. 

There is much support for the predication that the public is expecting educa- 
tional programs to become mor3 effective. Pi^ils idio in the past have been 
written off as ’’unteachable” are now expected to learn to read and demonstrate 
considerable skill. Thus, it is necessary to design assessment programs which 
can be used at the classroom, the school, the district, and the state l©vel 
and ^ch will yield information for decision-makers vho vash to improve the 

school programs. 

While there is pressure to ittprove educational programs, there is also pressure 
on education at all levels to reduce costs --or at least not to increase costs. 
With prices going va and money becoming scarce, taxpayers appear reluctant to 
provide additional funds for education, "niis is particularly true when the 
benefits vdiich can be expected from additional si^port are not apparent. 



Is an Educational Program Yielding The Desired Results? 

In assessing an educational progam, the most significant question must be, "Is 
the program yielding the desired results?” The desired results can be described 
in teims of knowledge to be acquired or skills and attitt^es to be developed. A 
representative skill might be "the ability to re^ an ^itorial from a local 
newspaper and in one 'sown words communicate the ideas from that editorial to 
anot£er person”. The desired results of an educational program may also be de- 
S terns of experiences which aro considered beneficial in themselves 
For exaittple, it ini^t be considered beneficial for all pupils to experiment with 

Teaching the age of eight. Obriously there are nimeroos re- 
sSS \diich ^ucational programs are expected to produce. It is not possible 
to determine whether they are producing the desired results until tiie o©sired 
results are identified. The desired results (i.e. , objectives) which ar se 
lected will be dependent upon the values of the society which the educational 
program serves. 



It is possible to conduct research and development projects designed to facili- 
tate the identification of desired results. As these results are identified, 
it is possible to develop techniques to determine the extent to ^diich desired 
results have been achieved. A major portion of the 1970-71 R § D allocation is 
being invested in such projects. 

When these projects are completed, it will be much less difficult for school 
board members, members of the State Board of Education, legislators, and the 
general public to describe the results which they expect from education. Like- 
wise, it ivill be much less difficult for professional educators to describe 
the extent to which those results are being achieved. Furthermore, it will 
also be possible for educators to diagnose the areas of weakness and to specify 
the kind of learning which will be required in order to attain the desired re- 
sults . 

The procedure which has been adopted in current R & L" pxcjects for developing 
assessment techniques is as follows: 

1. Ec.ch part of the curriculum is broken down into its fundamental 
areas of knowledge or skills. Each of those knowledge or skill 
areas is then divided into its logical sub-c-reas. In some cases, 
the sub -areas are sub-divided. Finally, specific objectives are 
identified for each of the sub -areas. These objectives represent, 
at least theoretically, the desired results of a curriculiM. An 
attempt is made to include all objectives which might be used in 
any program vathin that part of the curriculum. Consequently, it 

is likely that no single program will include all of the objectiv'es. 

2. With the above set of objectives available, persons responsible 
for a specified educational program are asked to identify those 
objectives which are included in their program. In this case, 
the term ''program” can represent a portion of a curriculum in 

a given classroom; it can also represent a portion of the cur- 
riculum in a school, in a school district, or in a total state. 

In any case, the set of objectiA/es described serves as the start- 
ing point. A statewide assessment of one area of the curriculm 
would include those objectives idiich all pupils at a given level 
would be expected to achieve. An assessment program for an 
individual classroom would also include all obj ectives which 
those pupils would be expected to achieve. Naturally, the two 
sets of objectives might differ. However, it would be assumed 
that the objectiAres selected for the state assessment program 
woiild be included among those idiich the piqiils in the individual 
classroom ■would be expected to achieve. 

3. After objectives are selected, assessment exercises are assembled 
which deal specifically wi'th 'those objectives. One or more items 
are identified for each specific objective. The items are care- 
fully screened so 'that it is likely that pupils who have achieved 



an objective vill be able to respond correctly and ptipils who have 
not achieved that objective will not be able to do so. As a re- 
sult when the test exercises are administered, persons responsible 
for the progrcUB will be able to ascertain which objectives have been 
achieved and ^diich have not. 



The above steps are designed to assist professional educators in identifying the 
desired results of their curricula. Hovrever, they are only a component of \diat 
is needed to help lay policymakers identify tlie results which tJiey . urograms 
should achieve. Therefore, additional steps are planned to relav.e ■r .-f-ral 

educational goals to specific objectives of tlie curricula. These ste^ = are as 

follows: 

4. Begin with the goals of education--e.g. , vocational eff icie:r_n' .. 
worthy home membership, command of fundamental processes, cim- 
jjiixnity participation, etc. Identify the specimen tasks viiicch 
relate to each of those goals. For example, a task relating r-: 
'Vorthy home membership” might be "for the individual to be 

to manage home budgets to conform mth family income." 

5, For each specimen task selected, identify the specific objec- 
tives in school curricula (described in number 2 above) wh:c± 
are requisite to the selected tasks. 

6 In reporting assessment results to policy makers and to the 

general public, results will be reported in teims of the tasks 
which have been derived froin the general educational goals. In 
other words, report that "87 percent of the seniors in high 
school appear to have the requisite skills for managing home 
budgets to conform wdth family income." 



There are presently 11 projects for developing techniques to assess results of 
educational programs. These projects are in the following areas: communication 
skills, art, music, reading, human relations skills, horticulture, science, 
mathematics, enployability skills, and business education. In all areas except 
reading, the goal is to have a catalog of objectives coi^leted by the summer 
of 1971 and to have a first version of assessment exercises which can be tested 
in individual classrooms by fall, 1971. In the area of reading, the goal is to 
complete all of the above steps by December, 1971 and to have rpults of a state- 
wide reading assessment ready to report in March, 1972. Only the development 
and field testing of assessment procedures in reading or in other areas will be 
supported with Research and Development funds. The actual implementat^n of a 
statewide assessment is considered an operational program of the Department of 
Education, rather than a research and development task. 



How Much do Educational Programs Cost? 



A second critical question is, "How much do educational programs cost? 



Presently , 



it is possible only to accomt for the expenditure of funds by local school 
boards; it is not readily possible to relate those expenditures to programs in 
the school curriculum except in cases where funds are appropriated exclusively 
for a given program Ce.g., an ESEA Title III project). Therefore, it i§ not pos- 
sible to relate costs to program results. 

For many years, it was ass\mied that the expenditure per pupil was a reliable 
index of the qiaality or effectiveness of a school program. However, recent 
experience with federal funds appropriated for Title I of the Elementary and 
Secondary Education Act suggests that increasing per pupil expenditures does 
not automatically increase pupil learning. Thus, it is necessary to obtain 
more precise information regarding program costs and to collect this informa- 
tion in terms of factors which seem to relate to pupil learning. 

The Department of Education is talcing a dual approach in developing the capa- 
bility to assess costs of educational programs. The major effort is being 
placed on the development of an accounting system vhich will replace present 
accounting procedures being used by local school districts in Florida. The 
system is expandable, allowing for detailed cost accounting. Even when used 
at the rainijitum level , the system will provide much more detailed information 
on the expenditure of funds than is now available. 

A secondary project is the development of a system for collecting information 
vhich is not a regular part of the accounting procedures . Such a system might 
be used to supplement routine accounting procedures when certain information 
is desired but where the cost of collecting that infoimation on a total school 
system might not be warraiited by anticipated benefits . Thus , the information 
WDiAld be collected on a sample of programs within the district. Another case 
for using the supplementary system might be one in which an identified need was 
not included in the accounting system. Thus, information would be collected on 
a sample of programs using the supplementary system. 

The supplementary system would consist of a set of standardized questions and 
data forms for collecting cost information. Data would be provided by teachers, 
administrators , or other appropriate personnel . 

It is planned that a coirplete new accounting system will be ready for inplemen- 
tation statewide at the beginning of the 1972-73 school year. The supplementary 
system will be ready for use in pilot projects during the fall of 1971 in con- 
junction vdth new techniques for assessing program results. 



Are Resources Being Used Effectively? 

Once information on program results and costs is available, it is possible to 
deal with the critical question, "Are resources being used effectively?" It 
bears repeating that without information on program results, any question re- 
garding the effectiveness of resource utilization is- purely spec^ative. If 
program cost is a concern- -as it usually is — it is also unrealistic to con- 



sider the question of effective resource utilization without information on costs. 

The productivity of resources is a key element of an organized educational program. 
The productive u==e which a classroom teacher makes of potentially available re- 
sources constitutes the art of teaching. Likewise, the productive use by principals, 
superintendents, and state education officials of resources which are potenti^ly 
available constitutes the essence of educational nanagement. An analysis if ^e 
use of educational resources is an analysis of the educational processes wnich 

are taking place. 

The rssources to be used include staff, materials , facilities (space), pi^ils, 
methods and time. The first three resources -- staff, materials, and facilities -- 
normally cost money; therefore, these items will be included in the cost analysis 

system. 

It should be recognized that there is presently no absolute index of the produc- 
tivity of resource utilization. While it is possible to compare cost per pupil or 
pupil achievement from one program to another, it is unlikely that it is possible 
to compare program effectiveness (i.e., the effectiveness of resource utilization) 
of tv>ro programs unless the objectives of both programs are identical and the pupils 
enrolled in the programs are identical. Such an occurrence is improbable; while 
there may be programs with identical objectives, it is difficult to find identical 
pupils Nevertheless, veiy meaningful assessments of resource productivity can 
be obtained if cost data and information on program results are also analypd. 

The main question to be answered by such an assessment is, "Can the productiva,ty 
o£ resources be impix)ved?" 

The productivity o£ educational resources is said to be in 5 )roved (a) when costs 
are reduced without an accompanying loss in pupil achievement , (bj when P^ii . 
achievement is increased without increasing costs, or (c) when both pupil achieve- 
ment and costs are increased but the increase in achievement 15 judged by decision- 
makers to warrant the increase in costs. 

The first step in developing a system for assessing resource utilization is to 
identitfy alternative types of activities in which pupils may engage in order to 
accomplish the educational objectives. The full range of alternatives should be 
identified, from unsupervised independent study which takes place outside the 
contexts of formal education, to indiiadual tutoring by a skilled professional 
in a school setting. For each type of learning activity, the following infoimation 

will be specified: 



1 . Time requirements . 

2. Skills or competencies required of the pupil in order to participate 
in this kind of learning activity. 

3. Attitudes required of the pupil in order to participate in this type 
of learning activity. 



ISdl 



4. Medxa or materials required. 

5. Facility or space requ ' , sments . 

6. Personnel siQjport (i.e., assistance from teachers, aides, other 
pupils, etc.). 

APtematives or combinations of alternatives, for each of the above need to be 
icxentified. Relative cost factors are then assigned to each alternative. For 
personnel alternatives, competency specifications must be set forth. Also, each 
t}pe of pupil learning actiA/lty should be related to the types of objectives 
fcT which it is most appropriate. 

The next step is to develop, or identify, instruments which can be used to de- 
scribe the status of the above variables in any school or educational program. 

As a result of applying the instruments, it should be possible for professional 
educators to make wise judgments about the productivity of resources in a school 
or educational program. On the basis of those judgments, the program can be 
modified. If subsequent cost analysis information and assessment of program re- 
sults --when taken together- -indicate that program effectiveness did improve, the 
wisdom of the judgnent made by the professional educator is confirmed. 

While the system under development is designed to help professional educators 
make better decisions about resource productivity, it should be recognized that 
lay policy makers must assume a vital role in the implementation of the system. 
Noimally, it will be lay policy makers who give sanction to the objectives which 
have been adopted for the educational program being analyzed. Also, cost con- 
straints for educational programs are normally established by lay policy makers. 
It is within the context of established objectives and limitations on cost that 
the professional educator must recommend the type of resource utilization which 
is likely to be most effective. However, when a new pattern of resource utili- 
zation is introduced, it will be the assessment of program results and the 
analysis of costs which are the primary indices of effectiveness. 



Coordinating and Managing the Development of Assessment Techniques 

The establishment of the developmental program described in this chapter places 
a significant responsibility for coordination and management upon the Department 
of Education. First, it is necessary for each assessment project to develop 
techniques that are coii^atible with the programs which they are to assess. For 
this reason, each assessment project is closely monitored by a Department of 
Education consultant in the special area which is represented. The assessment 
project in art is monitored by the art consultant, the assessment project in 
horticulture is monitored by a consultant in agricultme education, the cost 
assessment project is monitored by a consultant from the Bureau of School Finance, 
and similarly mth each of the other projects. 

A second kind of coordination is also necessary. Since all projects are expected 
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to produce coraponeixts for an overall assessment system, it is necessary that all 
projects be compatible along technical lines. To acco^lish this type of co- 
ordination, a team of four technical coordinators has been identified. The tech- 
nical coordinators are university faculty members released from their regular 
duties to assist personnel v/orking on local projects. The technical coordinators 
perfoim the following roles: 



Consultants on technical problems or issues related to the develop- 
ment of criterion- referenced test exercises. 



2. Resource persons for identifying external sources of objectives 
or tests items. 



3, Trainers of project personnel in techniques for writing objectives 
and tests items. 

4. Representatives of the Department of Education in monitoring tech- 
nical aspects of projects. 

Technical coordinators are supported through contracts between the Department of 
Education and the institutions in which they are anployed. It is anticipated 
that additional services of i±±s type will be required as the number of assess- 
ment projects is increased. 



CHAPTE51 III 



identifying and evaluating alternative 

POLICIES AND PRACTICES 



In Chapter I, a new state strategy for improving education was described. This 
strategy consists of reducing restrictions on persons responsible for educational 
programs and at the same time increasing requirements for accountability. It is 
apparent that all educational programs should not be required to be identical. 

In fact, it is grossly unfair to declare an educator to be accountable and then 
severely restrict the options available to him in carrying out his program. 

At the same time, it seems unwise to discard the educational policies md prac- 
tices idiich have survived tlirough the years as representing the best thiriking 
of policy makers and practitioners. Therefore, the Department of Education has 
undertaken a systematic program to identify and evaluate alternative educationaJ. 
policies and practices. The goal of this program is to explicate alternatives 
so that they can be adopted when appropriate. 

It should be recognized that policies and practices vhich are currently in use 
are included among the available alternatives. The R ^ D Program is not seeking 
novelty as an end in itself. The ei/aluation techniques and instruments which 
are under developnent will be used to assess current methods, as well as alter- 
natives to those methods. 

The major goal for the R 5 D Program as well as for the total Department of 
Education, is to increase the productivity of Florida’s educational system. 

The conditions indicating increased productivity are the same as ^ose described 
earlier as being indicators of the improved utilization of educational resources. 
Educational productivity increases when any one of the following conditions are 
present: C®]) costs are reduced without an accompanying loss in pupil ai^ieve- 
ment, ptipil achievement is increased without increasing costs, or Cc) both 
pi 5 >ii achievement and costs increase but the increase in achievement is greater 
(i.e., more significant) than the increase in costs. 

A network of particinating schools will be established in which the relative 
productivity of a ’»tfide variety of educational strategies can be evaluated. 
Evaluations will employ instruments and techniques developed in the R § D Program. 
Thus, comparable evaluation results will be obtainsd from all projects. 

It was not possible to begin the evaluation of alternative practices during the 
first operational year of the R 5 D Program, since the assessment tec^iques are 
still under development. However, several projects are underway to identify and 
develop alternative practices vhich have been recommended for consideration by 
advisory groups. These projects are? summarized in this chapter. 



Individualizing Instruction 

It is generally agreed that instruction must be individualized if pupil learning 
is to be increased. Thus, the individualization of instruction is a key concern 
among persons interested in increasing educational productivity. A major project 
under the R § D Program ^■^ill design, develop, demonstrate, and evaluate an opti- 
mized system of individualizing instruction for a public elementary school. This 
system mil take advantage of the most well developed and promising materials, 
techniques, and procedures available throughout the nation. The model will be 
demonstrated in an existing Florida school with existing faculty members. The 
model will be designed for dissemination to other schools throughout the State. 

The project is beginning with a design effort involving substantial commitments 
of time by faculty members of Florida State University and other institutions 
in Florida. This will be followed by a developmental effort involving the system- 
atic development of components and techniques in a controlled environment in the 
University Elementary School at Florida State University. Key faculty personnel 
from selected public schools in the State will participate in the planning phase 
of development. 

The next step will be a demonstration effort, installiiag the developed model of 
individualized instruction in a public elementary school. This will include the 
establisliment of the conponents of administration, management, teacher preparation, 
and instruction within a total system designed to have the potential for ivide- 
spread dissemination to Florida schools. One or two satellite schools within the 
same school district will be selected to serve as hosts for tlie installation of 
tlie model in existing school environments. Evaluation of the program will be 
planned concurrently with the design of the system. 

A second project related to individualized instruction is a short term activity 
in the area of reading. It is a project to install the Hackett Reading Systems 
in 290 classrooms at all levels. The Hackett Systems consist of a set of behav- 
ioral objectives for instruction in reading with a test sheet prepared for each 
objective. Classroom teachers and aides have been trained to administer the 
tests. Teachers then use the results of the tests to prescribe learning activi- 
ties for individual pupils. Standardized tests were administered to participating 
pupils, as well as to a control group, prior to the beginning of the project. The 
tests will be administered again at the end of the school year so that achieve- 
ment of pupils in classes where the systems were used can l3e compared with 
achievement of pupils in comparable classes where the systems were not used. 

A third project for individualizing instruction is designed to identify techniques 
of teaching which actively involve students in the instructional process. This 
project will identify techniques v/hich teachers can use to involve students in 
instruction. It will then develop training materials for both teachers and 
students so that the techniques can be implemented generally. These materials 
will be available by the end of 1971 . 



Projects Relating to Educational Personnel 



Educational personnel must be a major focus of any effort to improve the produc- 
q£ gjj educational system. It is generally agreed that, \vithin the system 
of public education, teachers are the most important factor in educational achieve- 
ment of pupils. Furthermore, the proportion of the educational budget allocated 
for salaries of teachers and other instructional personnel ranges from 75% up- 
ward. 

One project related to the utilization of educational personnel was initiated 
the Department of Education prior to the establishment of the R § D Program, 
project, which is in its second year, aims at flexible staff utilization 
and is designed to train personnel to fxmction within different patterns of 
staff organization. During the first year, the emphasis was on diss^ination 
q£ information regarding possible alternative patterns of staff utilization and 
on trainiijg state leadership personnel. During the current year, the emphasis 
is on training personnel in local schools. Three school districts are partici- 
pating- -Dade County, Sarasota County and Leon County- -along with the Department 
of Education. During 1971-72, the emphases will be on training additional per- 
sonnel for full implementation of alternative patterns of personnel utilization. 

The Department of Education has also been conducting a number of other activities 
to specify the competencies which teachers are expected to demonstrate and to 
improve the training of teachers in those competencies. These activities have 
included (a) recommending statutes and regulations which will promote teacher 
training and licensure practices built on specified competencies and (b) sup- 
porting the development of new training materials and procedures aimed at speci- 
fied conpetencies . A limited number of individualized teacher training modules 
have been developed and are now in use in preservice and inservice teacher training 
programs within the State. 

It should be noted that in Florida, as in other states, teacher training progr^s 
and teacher licensure requirements are based upon professional judgment regarding 
the competencies which teachers should possess. This is not unreasonable, since 
professional judgment is the best evidence available. However, at its meeting 
on January 29-30, 1971, the R § D Board of Governors made the following recommen- 
dation: 

"The Department of Education should seriously consider a policy which 
would provide that by 1974, teacher certification requirements would 
be based only on research evidence showing the relationship between 
those requirements and pupil achievement. The Department should insti 
tute research projects which will generate infoimation showing the 
relationship between specified teacher characteristics or behaviors 
and pupil achievement." 

The Department of Education is now preparing a plan to consolidate and expand its 
research and development activities in teacher education, 'fhe plan has the fol- 
lowing components: 
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1. Develop con 5 )rehensive statements o£ teacher competencies, leading 
to the development o£ instruments £or assessing those competencies 
similar to the instruments being developed imder the R § D projects 
for assessing pupil learning. 

2. Conduct research to demonstrate rhe relationships between teaching 
competencies and pi 5 )il learning. 

3. Identify" or produce materials for training teathers and other edu- 
cational personnel in specified competencies. 

4. Assist ins"T itutions and school districts with staff development 
for teachex' training personnel so that newly developed training 
materials and techniques can be used in their programs. 

The initial development of "the conprehensive statements of teacher competencies 
and the assembly' of training materials has begun. Remaining parts of the plan 
mil be supported from subsequent R q D allocations and from other sources. 



Other Projects 

Three additional projects aimed at alternatives which mil increase the pro- 
ducti"vity of the educational system are underway. Only one of these projects in- 
volves a significant investment of R 5 D funds. It is a project to promote ex- 
panded use of school resources to serve the community and is intended to bring 
the schools and community closer together. This project is designed to facilitate 
the implementation of the Florida Community School Act of 1970. That Act pro- 
"vides support to local school districts which wish to employ community school 
directors and establish community school programs. The importance of systematic 
training for community school directors has been enphusized repeatedly by con- 
sultants Inowl edge able in community education. They view a successful training 
program as the key element to make the community school program successful. 

Since short term programs which could handle large numbers of community school 
directors are not available, the R 5 D project is aimed at developing and dem- 
onstrating such a program. The project also includes the training of "three 
persons who will be qualified to conduct the training program at regional 
centers within "the State. The training program will include a three-week pre- 
service session followed by appropriate inse"Tvice activities. Training objectives 
for the program will be carefully specified and techniques for e"valuating the 
extent to which objecti"ves are achieved are also being developed. The program 
will be indi"vldualized and performance based. The R 5 D sipport for the train- 
ing program will be limited to de"velopment , training for three persons who will 
conduct the program, and one field-test. 

The second project is designed to extend the school year and thus pro"vide for 
more efficient use of school facilities. This project was established by the 



Florida Legislature. It provides support to projects in Dade County, Clay County, 
and Bradford County. Each county is taking a different approach to extending the 
school year. The approaches are (aj a "quinmester” plan with staggered attendance, 
(b) a summer program combining the goals of enrichment and acceleration not to ex- 
ceed one year in thirteen (K-12) , and (c) an extended teim plan. 

The final project deals with alternative ways of using educational capital. It 
has been suggested that the most important inhibiting factor to school reform 
and renewal is the line item budget, commonly the sole budget for the school 
enterprise. Recent experience at federal, state, and local levels in the expen- 
qF many billions to secure better and more responsive practice in the 
ptiblic schools suggests that the pattern of funding, the mix of funds and the 
mechanism for allocating dollars, may be as important for the success of a given 
program as the actual amount allocated. 



One alternative method for using funds is performance contracting. With ■^is 
approach, a school district defines results that it expects. It then invites 
proposals from individuals or firms which will agree to meet its expectations . 

Such a project has been undertaken in Duval County with support from ESEA Title 
I funds. The Department of Education, as part of its Educational Research and 
Development Program, is studying the Duval County project, along with other pro- 
jects to identify strengths and weaknesses in the performance contracting approach 
^d to subsequently provide information to others who are considering performance 
contracting. 



Policy Alternatives 

The term "policy" is intended to denote those broad goals, principles, and guxde- 
lines which chart the path for educational programs. In any effort to hrprove 
education, the underlying policies are primary determinants of tne types of 
improvement projects which will be supported. The underlying policies also pro- 
vide the rationale for interpreting the results of those projects. 

A comprehensive improvement program employing educational research and develop- 
ment as a strategy should certainly include' a component for studying educational 
policy. The interactive effects between policy and technology are powerful. 
Restrictive policies can discourage or thwart the development and application 
of certain kinds of techniques, while encouraging others. For example, the 
present concern for enA/lronmental quality has spurred the development of a 
polution-free automobile and has halted the development of a large airplane 
which travels at supersonic speeds. Likewise, technological advances can make 
certain policies appear outmoded. This is illustrated by the changes in highway 
speed limits vdiich were brought about by advances in techniques for constructing 
highways and for constructing vehicles. 

It is not being suggested that policies must be changed to make way for technology. 
More often than not, the judgment will probably go the other way. Since tech- 
nology is expected to serve people, rather than vice versa, policy studies should 



lead to policy recoiiinendations which are consistent with the aims which people 
hold. With clear policies, the development o£ technology can proceed in a manner 
which will serve the people. 

The foregoing ideas have a clear application to the Florida Educational Research 
and Development Program. When many of the current educational policies were 
adopted, they were not considered in the light of technological advances which 
could accrue from the R § D Program. Consequently, certain policies may un- 
necessarily hinder developments which could occur under R ^ D. Also, there is 
a possibility that new policy guidance is needed to aAn^id tindesirable conse- 
quences ^ich could result from poorly selected R § D targets. 

A major concern in policy studies is with the consequences of a proposed or 
established policy. A policy can be considered desirable or undesirable on the 
basis of the consequences which are likely to accrue as a result of adopting 
the policy. In examining the consequences of a policy, it is inportant to con- 
sider the full range of persons or events which may be effected by the policy. 

For example, in considering a policy for educating kindergarten children, it 
is important to consider the consequences in terms of the children (present and 
future) , the parents , the teachers , the school administrators , and the community 
large. A second consideration in policy studies is the relationship between a given 
policy and other established policies. Ideally, the total domain of policies 
governing a program should conprise a network of logically associated policies 
with consistency throughout. 

The R ^ D project for analyzing policy alternatives is aimed at developing the 
capability within the Department of Education for conducting such analyses. This 
project will provide training to Department staff members and will also provide 
technical assistance in policy analyses. 



Management and Coordination of Projects 

As with the assessment projects discussed in the preceding chapter, the manage- 
ment and coordination of the projects for evaluating alternative policies and 
practices present a special challenge to the Department of Education. Each of 
the projects described in this chapter is monitored by a Department of Education 
consultant in the special area represented by the pro j ect . No contracts for 
external management or coordination of these projects were issued in 1970-71. 
However, it is anticipated that during 1971-72, it will be necessary to allocate 
funds for supporting external management and coordination activities. Such si;p- 
port will be required primarily to coordinate the activities of the network of 
participating schools and to provide technical assistance to those schools. 
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CHAPTER IV 



expectations for the FLORIDA EDUCATIONAL 
RESEARCH AND DEVELOMENT PROGRAM 



Section 229.561(2) (b) 12, Florida Statutes, requires that the Board o£ Governors 
for Educational Research and Development submit an annual report . . pointing 
out significant and new information, practices, or other benefits which have 
been acconplished through the program.” Those accomplishments are described 
throughout this report. In the present chapter, the aim is to summarize those 
accomplishments and to put them into perspective. 



To this date, the major accomplishment has been the establishment o£ a signifi- 
cant^new capability in tlie Department of Education; namely, the capability of 
allocating developmental resources for transforming ideas into possibilities. 
T-raditionally state resources have been appropriated to pay teachers, build 
Schools, buy textbooks, and transport children. It has been very difficult to 
use available funds to develop more effective techniques for casing out the 
Sss^on of education. Thus, the Department of Education, the State's domin^t 
?^lde?sh?p SSy iS education, has been limited in its capability to transform 
ideas into true possibilities. 



The second major accomplishment is the actual establishment of a series of inter" 
related research and development projects directed toward identified state needs. 
This is no mean accomplishment if viewed alongside other government -sponsored 
efforts in educational research. The normal pattern has been one of building 
research programs around the expressed interests of researchers in the field, 
rather than around needs systematically identified by the agency responsible for 
providing educational leadership. The projects now in progress under the Florida 
R § D Program will provide techniques for assessing educational costs, processes, 
and results. Additional projects are underway which will produce techniques for 
making education more effective. 



The third major accomplishment of the R § D Program^ is a natural outgrowth of 
first two and is possibly the most significant. This accomplishment is manifested 
in statements of expectations which were not held previously. The Board of Governors 
along with the Department, holds bold expectations for the R § D Program. Needless, 
to say, expectations are significant forebearers of results . 



Expectations 

The R § D Program is aimed at transforming three significant educational ideas 
into possibilities: increased productivity in the educational system, increased 

accountability for educational programs, and continuing self renewal in all of 
education. These ideas are not isolated but inter-related. Each is dependent 






upon the others for its success. 



Inoreased -Educational productivity is increased when one of the 

following conditions is present: (a) costs are reduced without an accompanying 

loss in piipil achievement, (b) pupil achievement is increased without increasing 
costs, or (c) both pijpil achievonent and costs increase but the increase in 
achievement is greater (i.e. , more significant) than the increase in costs. 

Many writers and researdiers over the past decade have asserted that the level 
of expenditures is a valid index of program quality. However, recent studies 
have demonstrated that increases in expenditures do not necessarily result in 
increases in pupil achievement. The R § D Program is designed to identify and 
demonstrate techniques for increasing productivity. 

Inoreased Aaoountcdriti,ty .--Ac.c.ovsitabi.lxty is defined as "the process for ex- 
plaining the atilization of educational resources in terms of their contributions 
to the attaircinent of desired results.” The magnitude of the public investmen;t in 
education, as icrell as the tenor of the times, has placed educational managtni 
under pressure to account for their stewardship of financial and human re^'rorces. 
Teachers and other school officials are not unwilling to be accountable. However, 
they do not f oel that the present methods for assessing pupil learning or f '/r 
assessing resource utilization are adequate for accountability. The R § i to- 
gram is develop.ing new assessment techniques which will make accountabilitry' In- 
creasingly more feasible. 

Self -RenewaZ . ~ -Self renewal is the process whereby an institution continual 
modifies its goals and objectives to meet the needs of its c‘'ients and ccut^m- 
ually modifies its program to facilitate the attainment of its objectives. Self- 
renewal requires (a) continuous monitoring of the extent which a program is 
achieving its objectives, (b) continuous evaluation of the appropriateness of 
established objectives, and (c) continuous identification of alternative policies 
and practices for consideration. Self- renewal requires a focus on the goals which 
an institution should pursue, rather than on the institution as an end in itself. 
Institutions which fail to renew themselves are often those which become pre- 
occupied with their established traditions and practices, while giving only 
secondary attention to their goals. The R § D Program will proA/lde techniques 
for analyzing the extent to which goals are attained and will identify and 
demonstrate alternatives for achieving educational goals. 



Targets 

The Board of Governors has specified targets which relate to the expectations 
described above. These targets are ambitious, yet realistic milestones for 
achieving those expectations. The targets represent improvements in educational 
management, in persoTmel training and credent ialing, and in educational technology. 

By Z9?2.~~f>y the end of 1972, techniques for improving educational management 
will be available and readily accessible to all school districts in Florida. 

These will include techniques for (a) obtaining criterion-referenced measures 



o£ pvcpil achievement in grades K-6 in basic skill areas taught in those grades, 

(b) obtaining detailed analyses o£ educational costs, and (c) obtaining analyses 
^1^0 0f f 0ctiveness o£ resource utilization, i^th recommendations £or improve — 

ment . 

Bif 1974, --By the end o£ 1974, competencies expected o£ teaching personnel in 
elementary and secondary schools will be clearly identi£ied. Evidence will be 
available showing relationships between teacher competencies and pupil learning. 
Teacher training techniques will be available £or xise in preservice and inservice 
teacher education programs which are aimed at the speci£ied competencies. Evi" 
deuce will be available to State policy makers which shows the extent to wMch 
teacher e££ects on pupil learning support various credential ing requirements. 

By 1976. --By the end of 1976, techniques will be available and accessible to 
each school district which will make it possible £or every child who is not 
severely handicapped to master the basic skills o£ communicatron and computation 
during the elementary grades o£ schooling at an average per pupil cost which is 
within the range of tl:n n imal operating budget of any school district in Florida. 



R § 3 Budget: 1971-72 

'■fjjg Eoard of Governors recommended that the Commissioner of Education request 
$4 million to operate the Educational Researcli and Development Program (hiring 
1971-72. This compares x\rith $1.2 million which was allocated for 1970-71, the 
initial year of operation for the program. The funds would be distributed over 
five kinds of projects. The types of projects are listed below, showing the man- 
ner in idiich funds were expended in 1970-71 and the recommended spending plan for 
1971-72: 





1970-71 


1971-72 


Development of assessment techniques 


$600,000 


$1,200,000 


Demonstration and evaluation of alternative 
educational techniques in a network of individ- 
ual participating schools 


-- 


1,000,000 


Projects to develop or demonstrate new techniques 
for subsequent field testing in participating 
schools 


365,000 


800,000 


The development of new teacher training tech- 
niques and research on teaciher competency 


135,000 


600,000 


Consultation and acininistrative support 
(Board of Governors, Advisory Council, outside 
consultants on total program, contraczts for 
manageinent support and technical assistance to 
network of participating schools) 


100,000 


400,000 



Expectations, Possibilities and Promises 

Early in tliis Chapter, it was asserted that a major achievement of the R § D 
Program for 1970-71 has been the establishment of expectations for increased 
productivity, increased accountability, and self- renewal in education. It 
was further asserted that the mission of the R 5 D Program is to transform 
these expectations into possibilities. It must be recognized, however, that 
the R § D Program can prcamise only that the expectations will truly become 
possible. Tliert; are many individvials , grotqjs, and corporate boidies which 
influence the direction of education in Florida, The R § D Board of GciTemors 
feels that a true demonstration of the possibilities for increased productivity, 
accountability and self- renewal will be a significant contribution to Florida 
education. Hopefully, the state legislature, the State Board of Education, 
the Commissioner of Education and his staff, the local school boards, the local 
school administrations , the school faculties, the pijpils, the parents, and the 
general public i\all espouse these same expectaiti:’ns . If this occurs, the pos- 
sibilities will become promises. All will benefit. 
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APPENDIX A: 



legal authorization rOR Tiffi FLDRIDA 
EDUCATIONAL RESEARCH AND DEVELOPMEJCf PROGRAM 
CSection 229.571, Florida Statutes) 



Education:::; rcso.irch ;ind develop- 
jrient. — There is here, r crcat^^d an educational 
research and developiT'^nt program which shall 
be administered by thx- commissioner of edu- 
cation. It is the intent of the legislature that 
a specific sum of funds shall be allocated 
each year for the soie purpose of sponsoring 
the designing, development, testing, and eval- 
uation, on a pilot project basis, of applied 
or action research studies or projects which 
seek information on questions of critical con- 
cern to present and future educational needs 
of this state. The commissioner of education 
shall develop and implement an educational 
re.seaxch and development program as herein- 
after provided. The commissioner of education 
shall develop and transmit, at least thirty 
days prior to the 1970 regular session of the 
legislature, to members of the state board of 
education, the pi*esident of the senatc» the 
speaker of the house of representatives, and 
members of the senate and house committees 
on education a detailed plan for implementin;:: 
a program of applied educational research and 
development. The plan shall be for foui' years 
of operation beginning July 1, 1970. The plan 
shall be in detail for the 1970-1971 fiscal 
year and the funds to support projects for 
1970-1971 shall be included in the legislative 
budget of the state board submitted to the 
governor as chief budget officer of the state 
for the 1970-1971 fiscal year. The plans sub- 
mitted in 1970-1971 for the second through 
the fourth year may be stated as a general 
long-term plan and will not require detailed 
cost estimates. 

*{1) ADVISORY COUNCIL.— The board of 
education shall, within thirty days following 
the effective date of this act, appoint an edu- 
cational research and development advisory 
council from a list of two or more names 
nominated fo;r each position by the commis- 
sioner of education. 

(a) Membership . — The number of individ- 
’ uals appointed to membership on the advisory 
council shall be determined by the state board 
of education; provided, however, that at no 
time shall the total membership of the ad- 
visory council consist of less than twelve 



persons. Each member shall be appoints , for 
a period of one year. Members shall be eligible" 
for reappointment. The membership anc the 
total number of members may change from 
time to time as deemed appropriate bj the 
board of education. In making appointnuents, 
the state board and commissioner shall in- 
sure that the membership shall include ri‘pre- 
sentation from various segments of education 
and shall ii\clude lay citizens and students. 

(b) Duties and responsibilities . — As soon as 
practicable, following appointment of the 
initial members of the advisory council, the 
commissioner of education shall call an or- 
ganizational meeting of the council. From 
among its members, the council shall elect 
a chairman, who shall preside over meetings 
of the council and perform any other duties 
directed by the council or required by its 
duly adopted policies or operating procedures. 
The council shall also perform the following 
duties and responsibilities ; 

1. Within ninety days following the effec- 
tive date of this act or on September 30, 1969, 
whichever is the earlier date, the advisory 
council shall recommend individuals for nomi- 
nation to membership on a board of governors 
for educational research and development. The 
advisory council shall recommend to the com- 
missioner of education the names of at least 
fifteen individuals who shall include both lay 
citizens and professional educators of national 
prominence in education. The commissioner 
shall nominate two or more individuals for 
each position on a board of governors for 
educational research and development. 

2. Make recommendations, as it deems ap- 
propriate, to the board of governors concern- 
ing the establishment and operation of a pro- 
gram of sponsored educational research and 
development as provided by this act. 

3. Be knowledgeable about all projects 
sponsored under the provisions of this act 
and make such recommendations to the board 
of governors as in the opinion of the members 
of the advisory council will be of assistance 
in improving the program. 

4. Review the evaluative data on each proj- 



eclt sponsored under the provision.3 of this act 
and make recommendations to t:ne hoard of 
^rovernors about the potential heaedts the proj- 
ect information has for educat: on in Florida 
and strategies for implementing v.;, including, 
where appropriate, priorities, target areas, 
phasing, or sequence. 

(c) Payment of expenses, — ^JliLmbers of the 
advisory council shall be entJtlijd to receive 
per diem and expenses for travt while carry- 
ing out official business of the council. Such 
expenses shall be paid in aceerdance with 
state law relating to official state travel. The 
department of education shall approve pay- 
ment of such expenses in accordance with 
established rules and regulations. 

(2) BOARD OF GOVERNORS FOR EDU- 
CATIONAL RESEARCH AND DEVELOP- 
MENT. — The state board of ecucation shall, 
from the individuals nominated by the com- 
missioner, appoint a board oi governors for 
educational research and development. 

(a) Membership. — The board of governors 
shall not exceed nine members and shall in- 
clude citizens and professional representatives 
from several different levels of education and, 
to the extent possible, shall include individuals 
of national prominence in education from both 
within and without the state. The terms of 
appointment for each member shall be three 
years and until a successor is appointed, except 
in case of an appointment to fill a vacancy, 
in which case the appointment shall be for the 
unexpired term; provided, however, the terms 
of the initial members shall expire as follows: 
Three on July 1, 1970, three on July 1, 1971, 
and three on July 1, 1972. 

(b) Duties and responsibilities, — As soon as 
practicable following appointment of the board 
of governors, the commissioner of education 
shall call an organizational meeting of the 
board. From among its members, the board 
shall elect a chairman, who shall preside over 
meetings of the board and perform any other 
duties directed by the board or required by 
its duly adopted policies or operating pro- 
cedures. The board shall also perform the 
following duties and responsibilities : 

1. Make recommendations to the commis- 
sioner for establishing a program for educa- 
tional research and development as provided 
by this act. 

2. Submit to the commissioner of educa- 
tion, in priority groupings, specific educational 
and education-related questions which, in the 
opinion of the board of governors, are most 
critical to improving the effectiveness of public 
education in Florida. 

3. Establish criteria to be used in selecting 
a network of schools throughout the state to 
participate in conducting projects sponsored 
under the provisions of this act. 

4. Assist with defining specifications for 
projects to be sponsored by the educational 



research and development program. All proj- 
ects sponsored under the provisions of this 
act shall be .iesigned to state clearly the spe- 
; iiic objectives of the project, appropriate 
:ontrol£T zo insure reliability of data obtained 
crom the project, appropriate evaluation of 
the project, especially as to the attainment of 
stated objectives, and adequate dissemination 
of the results of projects. 

5. Recommend to the commissioner of ed- 
ucation projects which, in the opinion of the 
board, gjiould be approved for sponsorship by 
the educational research and development 
program. 

6. On the basis of the priority of projects 
to be undertaken and the criteria for selecting 
participating schools or centers, solicit, on a 
statewide basis, application from local schools 
and centers to be designated as a participating 
school or center. 

7- Review applications from local schools 
or centers and recommend to the commissioner 
of education the schools or centers deemed to 
be, in the opinion of the board, those which 
best support and serve the purposes of the 
educational research and development program. 

8. Review project specifications prior to 
approval for funding. 

9. Recommend to the commissioner of edu- 
cation a highly qualified person to be appointed 
to administer and direct the program of edu- 
cational research and development as provided 
by this act. 

10. Review, periodically, the activities of 
each sponsored project and make to the com- 
missioner of education any recommendations 
deemed by the members of the board to be 
appropriate. 

11. Recommend to the commissioner of ed- 
ucation strategies for implementing on a 
broader scale findings which have immediate 
relevance for improving the effectiveness of 
education in Florida. 

12. Review the evaluative data from each 
sppnsored project and at least thirty days 
prior to the convening of each session of the 
legislature, file with the commissioner of edu- 
cation for transmittal to members of the state 
board of education, the president of the 
senate, the speaker of the house of representa- 
tives, the chairmen of the senate and house 
committees on public school education, a re- 
port listing all projects sponsored under the 
educational research and development pro- 
gram up to that date and pointing out signifi- 
cant and new information, practices, or other 
benefits which have been accomplished through 
the program. 

(c) Payment of expenses, — Members of the 
board of governors for educational research 
and development shall not receive a salary 
but shall be entitled to receive per diem, 
expenses for travel and honoraria while carry- 
ing out official business of the board in ac- 





cordance with state law relating to oil!.,;* 
state travel. The department of educatior: si-:, 
approve payment of such expenses ana . 
raria in accordance with established rult;.:. 

NETWORK OF PART^I^-T:.T 
SCHOOLS OF EDUCATIONAL CEN 'Ki .l-o. - 
There shall be established a network ef piLrt 
ipating schools or educational centers ^v . 
shall be representative of all levels of 
school education, kindergarten through : .a 
high school vocational education and w . 
also shall be representative of the var: lus 
types of student bodies, organizational 
terns, staffing patterns, financial support, 
types of curricula generally prevalent in h lor 
(a) Selection of participating schools or r;^- 
ters. — Based on the priority of projecte to t " 
undertaken and the criteria established by 
board of governors for educational reae^r-J' 
and development, the principals and lacul- 
of the schools of the state shall be given ... 
opportunity to file, through the superintenot- 
of schools and district school board, an apr 
cation seeking to be selected and designate:;] 
as a participating school or educational cen- 
ter of the state educational research and devel- 
opment program. The advisory council and 
board of governors shall review the applica- 
tions, and the board of governors shall reccjra- 
mend to the commissioner of education tne 
schools or centers which in the opinion of Uie 
board will best support and serve the pur- 
poses of the educational research and devel- 
opment program. From the schools and centers 
recommended by the board of governors the 
commissioner shall designate the schools or 
centers which shall be eligible to participate 
in projects sponsored by the educational re- 
search and development program provided by 



this act* 

(b) Number of participating schools or cert.’- 
The number of participating schools or 

centers designated by the commissioner of 
education shall be limited to only those cennsr^ 
actually required to satisfactorily carry 
the projects sponsored by this program- 

(c) Waiver of laws or regulations tha 
event the commissioner of education is inro- 
vided evidence satisfactory to him that a 
state board of education regulation will pro- 
hibit the success of a project considered to be 
highly significant to education, the state board 
of education, upon hearing the evidence and 
justification presented by the commissioner 
of education, shall have authority to waive 
the regulation to the extent necessary for 
achieving the purposes of the particular proj- 
ect. Any waiver of a regulation authorized 
by the state board of education shall not be 
greater than that necessary to insure the 
success of the project, and such waiver shall 
not continue beyond the actual period require 



by the project. Each application filed by a 
school or center seeking to be designated 
as a participating school or center shall in- 
clude an official resolution by the district 
school board that when projects sponsored in 
schools or centers operated by that board re- 
quire w^aiver of Policies or regulations of the 
di.^trict school board, such policies or regu- 
lations will be waived in the same manner as 
prescribed to be followed by the state board 
of education in waiving regulations. In the 
event a proposed project will require the 
waiver of state board of education or district 
school board regulations, the commissiouer of 
education shall not approve such project prior 
to receiving evidence of the official action by 
the state board of education or the district 
school board that the ^impeding regulations 
have been waived for the purposes of the 
project. . ^ , 

(d) Cooperative support of project^.— Each 
application for designation as a paiticipating 
school or center shall include a resolution by 
the district school board that at least the 
level of financial support, staff, and other re- 
sources as provided for other programs within 
the district shall be continued for the^ school 
or center if it is designated as a participating 
school or center for the state educational re- 
search and development program. Funds avail- 
able through the educational research and 
development program authorized by this act 
shall be uced to nav only that cost which is 
incurred at a participating center which ^ is 
in adtliLion to the normal cost of operating 
the program in that district and which costs 
are a direct result of the slate educational 
research and development project being spon- 
sored in that school or center. Every effort 
ahull be made by the board of governors, the 
commissioner of education and the district 
school boards to combine funds available 
through the educational research and develop- 
ment program with funds from other sources, 
including both the public and nonpublic sec- 
tors, in order to achieve greater cooperation 
efficiency in the improvement of education. 



(4) ORGANIZATIONAL PROGRAM, 1969- 
1070 FISCAL YEAR. — The program .shall be- 
come operational at the be,,Mmiiig of the fiscal 
year following it.s creation anu authorization by 
the legi.^hitiJ»- 9 . The 1969-1970 fi.scal year shall 
be used for appointing and organizing the 
advisory cmincil and the board of governors, 
employi'ng stafT, developing the ma.ster plan 
for the program, and designating participating 
school.s or renters. 

lllntory.' M'. ch. 68-401: l|3l. 35. ch. 60-100, 

•Note. - ‘’Itripcndlng*’ changed lo ‘’Impeding by th© edUori. 
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APPENDIX B: 



NOTES ON THE FLORIDA EDUCATIONAL RESEARCH 
AND DEVELOPMENT PROGRAM, 1969-71 



This is a summary of the Florida Educational Research and Development Program 
as it has been conducted from its beginning in July, 1969 until the issuance 
of the Second Annual Report in February, 1971. The purpose of this summary 
is to relate the activities which have taken place in terms of the program 
description set forth in Section 229.561, Florida Statutes. 



Program Development 

During the fall and winter of 1969-70, nine areas were identified and recom- 
mended to the Commissioner of Education as appropriate foci for educational 
research and development. These nine areas sexwed as the basis for the First 
Annual Report on the Educational Research and Development Program. That re- 
port was issued on February 24, 1970. In the spring of 1970, regional meetings 
weie held in Tallahassee, Orlando, and Miami to revievvr the proposed program with 
educational researchers, administrators, and teachers. As a result of those 
meetings and subsequent counsel, recommendations were made to the Commissioner 
of Education to redesign the program, placing greatsr emphasis on inter -ro^la.t:mg 
the variolas types of projects. The aim should be to design a program with unity. 

During the summer and fall of 1970, the program was redesigned. The Second 
Annual Report describes the new conceptualization of the program. IVhile the 
projects to be conducted are essentially the same as those initially proposed, 
the emphasis on various kinds of projects and the probable sequence of activ- 
ities have been modified. 

The Second Annual Report was developed by the Board of Governors to describe the 
conceptual changes which the program has undergone. It is also intended to illus- 
trate the manner in which the initial operational appropriation -- 1.2 million 
dollars -- is being used to support the principles of state educational leader- 
ship which are emerging from the legislature and from the executive branch of 
government. These principles are described in the first chapter of the Second 
Annual Report as "A New State Strategy for Improving Education." 



The Advisory Council 

The statute establishes an Advisoiy Council which is responsible for nominating 
members of the Board of Governors and making recommendations to the Board of 
Governors, The Advisory Council met on the following dates during 1969'-70: 
September 18, September 29, November 5-6, December 5, February 9, April 27-29, 
and July 9. 
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The first t\vo meetings were used to nominate members for tlie Board of Governors. 

The third meeting was a joint meeting wath the Board of Governors to discuss the 
program. At the fourth meeting tlie Council reacted to the initial recommendations 
of the Board of Governors. At the fifth meeting a draft of the First Annual Report 
■was reviewed and recommendations were made. 

The next Advisory Council meeting was held in three sections, as Advisory Council 
members participated in the regional meetings described above. The final meeting 
of the 1969-70 Advisory Council was held to make general recommendations about 
the program which would be submitted by the Board of Governors . 

The State Board of Education appointed a new Advisory Council for 1970-71. The 
new Council is comprised of 9 returning members and 15 new members. The Council 
met on November 16-17, 1970 and on January 12, 1971. At the first meeting, the 
Council made a critical analysis of the R § D Program as it was being conducted 
and adopted recommendations to be submitted to the Board of Governors - At its 
second meeting, the Council reviewed and revised the recommendations made at 
the first meeting. A committee was appointed to present the recommendations to 
the Board. Also, plans were made to prepare a set of guidelines or bylaws for 
the operation of the Council. 



Board of Governors 



The legislation provides for a Board of Governors with membership not to exceed 
nine persons. This Board is responsible for recommending program guidelines, 
recommending specific projects, recommending pilot schools, and recommending 
ways for using the information or products which result from R S D projects. 

The State Board of Education appointed nine members to the Board of Governors, 
three for one year, three for two years, and three for three years. Two of the 
initial members were unable to serve and a third member resigned after two meet- 
ings. In February, 1970, two additional members were appointed. The three members 
who were serving one year terms during 1969-70, were re-appointed to three year 
terms in August, 1970. 

During 1969-70, the Board of Governors met on November 5-6, December 7-8, Feb- 
ruary 9-10, and May 1-2. The first two meetings were devoted to a review of 

R ^ D related activities in the Department of Education and to general dis- 
cussions of the type of educational research and development program which should 
be recommended. At the third meeting, agreement was reached on the content of 
the First Annual Report. At the fourth meeting, the Board received the recom- _ 
mendations from, the regional meetings conducted by the Advisory Council (described 
above) and recommended to the Department that the program be organized in a man- 
ner which will show the inter-relationship of the various projects. 

During 1970-71, the Board of Governors met on the following dates: July 10-11, 

1970, September 11-12, 1970, November 5-6,1970, and January 29-30, 1971. At 

the July meeting, the Board reviewed conceptual papers and specifications for 
projects which have been prepared by staff members and consultants. Refinements 
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were recommerxded for the specifications and the papers. At the Septein^r mating, 
statements from Commissioner Christian and other cop officials of the Department 
of Education were presented to the Board. After discussing tiie presenta^-ioris 
and reviewing program specifications which had been prepared, the Board 
mended that Applications be solicited imediateiy from public scnools in Florida 
to develop assessment instruments. At the Noven^er meeting, the Board reviewed 
applications from schools and recommended that the staff proceed to ^rJc out 
contracts for assessment instruments with selected applic^ts. ^e Board a^so 
recommended that contracts be negotiated with schools, universities, or otliers 
for additional R § D projects. 

At its January meeting, the Board reviewed the projects which had been devel^ed. 
Ihe Board recommended closer communication with the Advisory Council , along with 
special efforts to inform teachers and educational policy makers about the R q D 
program. It also recommended the development of projects to improve teaser 
education. Finally, the Board reviewed, edited and approved the draft of the 

Second Annual Report. 



Network of Particip.oiting Schools 

The legislation provides for a network of participating schools or educational 
centers. These schools are to be identified for the purpose of testing and evalu- 
ating techniques or products identified or developed under the Educational 
Research and Development Program, to the is 5 U^ce of the Second Annual 

Report, no pilot schools have been identified. Since the initial foci^ 

R S D Program is on developing assessment techniques, it is not practical 
conduct comparative tests of alternative educational procedures or products 
until the assessment techniques are developed. 

Applications for participating schools will be soliciated during the spring of 
1971. Following review of tliose applications by the Advisory Council and tte 
Board of Governors, the Commissioner of Education will designate participating 
schools . 

Participating school projects will be of two types: develo^ental prejects ^d 

field trials. The two types are representative of diffepn.. stages of develop 
ment of the techniques which are to be demonstrated in the school. A , 

mental project is one in which the idea has not been refine -^TOug ^ ^ 

work in a school setting. A field trial piojedt is one in i^ich ^ 
process has been conpleted, but the efficacy of installing the program m other 
schools has not been demonstrated- 

For developmental projects, R § D fimds can be Used to underwite extra training 
and simervisory costs necessary for a first trial, along ^tth the cos s 
monitoring and evaluating the project. For fi^ld trials, R § D 
limited to the cost of monitoring or evaluating whirh would not be necessa^ 
or expected In the normal operation of the program; installation costs will b 
the responsibility of the participating school. 



APPENDIX C: 



ANNOTATED BIBLIOGRAPHY OF UNPUBLISHED PAPERS 
WHICH RELATE TO THE FLORIDA EDUCATIONAL 
RESEARCH AND DEVELOPMENT PRDGRAI'l 



A sienifican" amount of conceptualization and planning has taken place during 
the development of the Florida Educational Research and Development Program. 
Much of this planning is documented by speeches, papers, minutes, announce- 
ments, and reports. The following is a chronological listing of some of those 
documents with brief annotations. Some items listed were not developed 
specifically for the Educational Research and Development Program, but repre- 
eSt parallel activities in the Department of Education. It should be noted 
also that the list is not definitive; certain parallel activities may have 
been inadvertently omitted. 

While the supply lasts, single copies of each of the documents listed 

may be obtained from Mrs. Nancy Benda, Research Associate, Florida Department 

of Education, Tallahassee, 32304. 



Minutes 

Minutes of all meetings of the Advisory Council and Board of Governors are on 
me in the Department of Education. Extra copies of the ^nutes are avail 
able for the Advisory Council meetings held on November 5-6, 1969; December j, 
?969; February 9, 1970; July 9, 1970; and for the Board of Gove^ors meetings 
held on November 6-7, 1969; July 10-11, 1970; and September 11-12, 19/0. 



Papers and Speeches 



1 . 



Flovd T. Christian, "Educational R §[ D; A Tool for Decision-Makers, 
September 19, 1969. This is the Charge presented by the Commissioner 
of Education to the Advisory Council at its first meeting. 8 pages. 



2 . 



3. 



lharles R. Russell, "A Survey of Innovations in Florida Schools; 
Preliminary Draft," December, 1969. Information collected in this 
survey was obtained exclusively from sources within the^ epartmen 
af Education. It describes a limited number of innovatiue programs, 
riie^criteria for selecting programs for inclusion in the survey were 
very restricted. 32 pages. 



Bob Burton Brown, "Tools and Techniques for Evaluating Innovations, 
December, 1969. Describes approaches to evaluating innovative pro- 
grams. Gives major attention to work which has been carriea out at 
the University of Florida. 14 pages. 
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4. "The Florida Educational Research and Development Program: First Annual 

Report," Febnaary 24, 1970. A document prepared by the Commissioner o£ 
Education for submission to the State Board of Education and Florida 
Legislature. The Report is based upon recommendations of the Board of 
Governors. 55 pages. 

5. "The Unity and Theoretical Underpinnings of the Florida Educational 
Research and Development Program," June 1, 1970. A statement issued 
by the Board of Governors. 3 pages. 

6. Lewis A. Rhodes, "The Management of the Florida Educational Research and 
Development Program," June 19, 1970. This is a draft for discussion pur- 
poses prepared by an outside consultant. It discusses the Research and 
Development Program from a "student centered" perspective. 36 pages. 

7. IVilliam H. Taylor, Jr., "Cost Analysis and Management Information System 
Structure in Florida Public Schools ," June 19, 1970. The paper describes 
the proposed development of a cost analysis -management information system 
that would be congruent with student evaluation and measurement instru- 
ments. 19 pages. 

8. E. Fred Daniel, "Moving Toward Accountability: Florida's Program," 

June 30, 1970. A paper presented at the conference on "Scate Leadership 
Toward Educational Accountability" held in Stone Mountain, Georgia, Jme 30 
thiuugh July 1, 1970. A revised version of this paper was published in 
Educational Technology Magazine , January, 1971. 

9. K. Fred Daniel, "Organizing Educational Research and Development to Make 
Differences in Florida Education," July 13, 1970. This is a draft for 
discussion purposes. The paper proposes that Educational Research and 
Development be made an integral part of the Department of Education oper- 
ations. 21 pages. 

10. Kc Fred Daniel, "Maiiaging Education," July 21, 1970. This is a draft for 
discussion purposes. It sets forth rudimentary ideas about education and 
about management which are proposed as being applicable to all levels of 
educational management from the individual classroom to the statewide 
educational system. Appears in Florida Schoo ls, January- February , 1971. 

8 pages. 

11. "Making Public Education Responsive to Changing Needs of Individuals and 
Society," August 11, 1970. This is a report prepared by an internal 
Department of Education task force charged with studying the role of 
the Department of Education in cost analysis, planning, and evaluation. 

6 pages. 

12. Shelley S. Boone, "Educational Research and Development in the Florida 
Department of Education," September 11, 1970. Remarks pi-esented by the 
Director of the Division of Elementary and Secondary Education to the 
Board of Govetnors. 5 pages. 
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13 . 



14. 



15. 



16. 



17. 



18. 



19. 



20 . 



21 . 



Flovd T. Christian, "Educational Research and Development m the Florida 
Department of Education," September 11, 1970. The Commissioner's remarks 
presented to the Board of Governors by Deputy Commissioner John Seay. 8 
pages . 

Carl W. Proehl, "Development of Florida's Vocational Education Program, 
September 11, 1970. Remarks presented by the Director of the DiArision 
of Vocational, Technical and Adult Education to the Board of Governors. 



James T. Campbell, "Educational Research and Development Under the Associate 
Commissioner for Administration," September 11, 1970. Remarks presented by 
the Associate Commissioner for Administration to the Board of Governors. 



"Preliminary Report; Florida's Plan for Educational Assessment," September 
30 1970 A report prepared by the State Commissioner of Education for 

submission to the State Board of Education and the Chaiimen of tj^ House 
and Senate Education Committees pursuant to the requirements of Chapter 
70-399 Laws of Florida. This legislation requires that the Commissioner 
of Education develop a plan for educational assessment and present this 
plan to the 1971 legislature. 6 pages. 

"Progress Report; Florida's Plan for Educational Assessment, October 30, 
1970. A progress report on the development of the State Assessment Program 
which is being developed pursuant to the requirements of Chapter 70-l>99, 
Laws of Florida. 4 pages. 



"Alternative Plans for the Future of Florida Education, ' November 12, 19/0. 

A draft of ideas for a project to stiKly aie consequences of alternative 
educational policies. 3 pages. 

"Designing a State Educational Assessment Program to Serve Two Masters," 
December 15, 1970. A draft for discussion purposes dealing with the problem 
of reporting assessment information which is useful to both the public an 
professional educate rs. 6 pages. 

Mary Ann Patalino and Gretchen Stangel, "Structure of Reading Skills," 
undated. This is a hierarchially arranged set of objectives for reading 
which was developed at the Center for the Study of Evaluacion, UCLA, it 
is a prototype of the way which goals and. objectives will be organize 
in other sub j ect areas . 39 pages . 

"Criterion-referenced Instruments, and Procedures for Measuring ; ■ tudent Com- 
petencies," December, 1970. This is a description., of criterion re eren e 
test items which is being appended to contracts for iJ-e development of such 
items. 3 pages. 
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APPENDIX D: 



R § D PROJECTS NOW UI'lDERV.T'.y 



Eacli project being supported with the funds allocated to the Department of 
Education for educational research and development is described below. The 
purpose of this appendix is to provide greater detail on the R § D Program 
is dsscTxbod in. tho body of this Toport ^ to account for R q D funds , 
and to fulfill Section 229 . 561 ( 2 ) Cb)l2, Florida Statutes. This section of 
the statutes requires the Board of Govemors to submit ' a report listing all 
projects sponsored under the Educational Research and Development Program 

pointing out significant and new information, practices, or other bene 
fits vdiich have been accomplished due to the program.” At the present time, 
the Board can only describe anticipated benefits, since the projects have 
only recently begun. 

The projects are organized according to the design for the Floric^ R § D 
Program which is discussed in Chapters II and III. That is, projects 
developing assessmont techniques are presented in one group and projects for 
developing alternative policies and practices are presented as a second group. 
The third group consists of projects for program development and management 
and completes the summation of funds appropriated for R § D. The outline for 
presenting projects is as follows: 

1.0 Projects for developing techniques for assessing educational 

results, utilization of resources and costs. 

1 . 1 Results 

1.2 Utilization of Resources 

1.3 Costs 

1 . 4 Combination Pro j ects 

2.0 Projects to develop and demonstrate alternative policies and 

practices . 

2.1 Policies 

2 . 2 Practices - contracts for development or dissemxnation 

2.3 Teacher Education 

3.0 Projects for program development and management. 



3.1 


Advisory 


Council 


3.2 


Board of 


Govemors 


3.3 


Internal 


operations 


3.4 


External 


support 
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The cost of each project is broken down into contracted and non-contracted 
expenditures from the R § D allocation, Non-contracted expenditures consist 
of funds used for in-house development . These funds have been used to bring 
together leaders in particiolar subject areas for the purpose of identifying 
goals consistent with State goals, specifying products to be developed under 
R § D contracts, and for providing related services. There are two exceptions 
to this use of non-contracted expenditures; notably 1,1, 07 --development activi- 
ties in music, and 1, 3, 01 --development of a cost determination system. In 
these two projects the actual development is taking place in the Department, 
Costs which are being absorbed in the regular operating budgets of the Depart- 
ment of Education or other agencies are not included in this Appendix, 



1,0 



1,1 



1 , 1,01 



1 , 1.02 



Project fo r developing techn i ques for assessing educational re- 
sults , utrli nation of resources, and cost^ 



Results 

Each of the foilcxving projects for developing criterion-referenced 
assessment techniques will folloxv'^ basically the same design. The 
facet of the curriculimi represen :.ed in each project will be broken 
down into its fundamental areas of knowledge or skills. Each of 
those knowledge or skill areas will be divided into its logical sub- 
areas. In some cases, the sub-areas will be sub-divided further. 
Finally, specific objectives will be identified for each of the sub- 
areas, These objectives will be arranged in a catalog which will 
include, as nearly as practicable, all objectives which might be 
used in any program within that part of the curriculum. It should 
be recognized that no single program will be expected to include 
all the objectives. 

Each of the objectives in the catalog will have corresponding test 
items to measure those objectives. The test items will be 
criterion-referenced and can be used to determine whether the student 
does or does not possess the skills or knowledge specified in the 
objective. The individual projects described represent developmental 
activities designed to provide the instruments and techniques for 
assessment procedures which can be used by teachers to manage in- 
struction and by district or state personnel to make decisions re- 
garding the management of the school system. 

Criterion- referenced measures and procedures in Art 
Contract; Palm Beach County $15,063.00 

Non- Contracted 1,941.00 

The catalog of objectives will contain objectives in Art for grades 
K-12. Test items will be written for objectives in grades 9-12, 

Criterion -referenced measures and p*'ocedures in Communications Skills 
Contract : Broward County $80,000.00 



O 
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1.1.05 



1.1.04 



1.1.05 



1.1.06 



1.1.07 



1.1.08 



1.1.09 



The catalog of objectives will contain objectives in comrmiiiication 
skills in grades 9-12. Test items will be written for objectives 
representing skills in writing and speaking. 

Criterion-referenced measures and procedures in Employability Skills 
Contract: Florida A § M University (Estimated) $32,000.00 

The catalog of objectives will contain objectives for employability 
skills in vocational education. Test iteiris will be written for the 
objectives. The details of this project were not finalized at the 
time of this report. 



Criterion- referenced measures and procedures in Horticulture 
Contract: University of Florida $32,702.00 

Non -Contracted 784.00 

The catalog of goals will represent goals in horticulture for pre- 
vocational or vocational education programs. The catalog will include 
objectives in ornamental horticulture and test items will 
be written for the objectives related to initial employability in 
ornamental horticulture. 



Criterion- referenced measures and procedures in Human Relations Skills 
Contract: Sarasota County (Estimated) $15,000.00 

Non-Contracted . . 1,651.00 

The catalog will contain objectives in human relations skills at a 
selected level. Test items will be written for the objectives. Final 
product specifications were not complete at the time of this report. 



Criterion-referenced measures and procedures in Mathematics 

Contract: Dade County ^^^’ovn'nn 

Non-Contracted . . 3, 870. DU 

The catalog of objectives will contain objectives in inatheinatics , K-z. 
Test items will be written for those objectives, 



Identification of objectives in Music 

sJon-Contracted . ^ 8,090.00 

rhe music consultant in the Department of Education has employed 
graduate students for the pu:^ose of organizing, selecting and re- 
\rising objectives for music in grades K-12. It is not expected that 
a contract will be negotiated for any further activity during 1971. 



Criterion-referenced measures and procedures in Secretarial Skills 
Contract: University of Florida 22 

Non-Contracted . . 814.00 

The catalog of objectives will contain terminal objectives in type- 
writing skills in business education. Test items will be written for 
those objectives. 



Criterion-referenced measures and procedures 
Contract: Florida State University 
Non-Contracted 



in Social Studies 

$35,000.00 

2,074.00 
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The catalog of objectives will include objectives for the concept 
"political systems" at the high school level. At least one test 
item will be developed for each objective. 



1 . 1.10 



1 . 1,11 



1.2 

1 . 2,01 



1.3 

1.3.01 



O 

ERIC 



Criterion-referenced measures and procedures in Science 
Contract: (not yet determine!) (Estimated) $90,000.00 

The catalog of ot 5 jectives will contain objectives for science at the 
middle school level. Test items will be written for the objectives. 
The Contract for this production had not been finalized at the time 
of this report. 

Assessing Reading Skills 

Contract: Center for the Study of Evaluation, UCLA $28,000.00 

Non-Ccntracted 1,235.00 

Instruments and procedures for assessing reading skills of students 
at grades 2, 4, 7 and 10 in each school district in Florida will be 
produced. This contract will provide the support needed to adapt a 
newly developed assessment system to the needs of Florida. It does 
not cover the actual development costs. 

Utilization of Resources 

System for Resource Assessment and Utilization for Instructional 
Improvement 

Contract: Florida State University $74,740.00 

A system will be developed for analyzing the productivity of educa- 
tional resources- -personnel (including pupils) time, facilities, and 
media. The utilization of educational resources is said to be more 
productive when (a) costs are reduced without an accompanying loss 
in pupil achievement (i.e., attainment of specified objectives), (b) 
pupil achievement is increased without increasing costs, or (c) both 
pupil achievement and costs increase but the increase in achievement 
is judged by decision-makers to warrant the increase in costs. When 
developed, the systan will be suitable for use in schools employing 
innovatiF’^e patterns of resource utilization (such as differentiated 
staffing) and will also be suitable for use in schools employing tra- 
ditional patterns of resource utilization. 

Costs 

Cost -Determination System 

Non-Contracted $18,550.00 

The development of a cost-determination system will make possible the 
forecasting of costs of various plans for education involving changes 
in the use of personnel, facilities, duration of efforts, and involve- 
ment of community resources. The Bureau of School Finance is assigned 
the initial responsibility for developing, testing, and implementing 
inproved costs analysis techniques for use in elementary and secondary 
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school programs including programs in area vocational schools operated 
by school boards. These cost ar alysis techniques will be, to the ex- 
tent nossible . compatible mth techniques used in the junior colleges 
and u^iiversities. The Bureau will work closely with the Office of the 
Department Comptroller and with the other three Divisions of the Depart- 
TT«^nt in designing cost analysis techniques- The ivorlc done in this pro- 
i’ect will be a part of the comprehensive planning which i.s oeing car- 
ried out in the House Special Study Committee. Although only $18,550 
has been allocated toward this effort, additional monies from ESEA 
Title V and other funds are contributing to the efforts imder the 
direction of Florida Statutes, Section 229.551 (3) and (4) ^d 229.811 
ril Cel and (d) . The amount allocated to the Bureau of Finance from 
the*R ^ D Program will be used to employ graduate assistants to do the 
routine work necessary to relieve DOE specialists to work on the cost 
analysis program- 

1.4 Combination Projects 

2.0 Projects to develop and demonstrate alternative polic ies arid practices 

2.1 Policies 

2.1.01 Consequences to Alternative 35 oOO.OO 

Lonrraci: i ox nn 

Non- Contracted ■, a.- i ^ ^ 

The capability of the Department of Educationfor conducting foimal 
analyses of consequences which could be anticipated from alternative 
educational policies mil be strengthened. It is anticipated that 
such analyses will involve the participation of councils which 
advise the Department of Education such as the Vocational Educational 
Advisory Council, Public School Council, Junior Colleges Adyisop^ 
Council, and State Council on Post -High School Education. Final 
details of the contract were not spec.i.f ;ed at the time of this 
report . 

2.2 Practices 

2.2.01 Hackett Reading System rr. nnn nn 

Contract: Motivation Systems (R 5 D Portion) $1^5,000.00 

Contract: Florida State University _ 

A contract to test the feasibility of using the Hackett Reading Systems 
in Florida public schools has been negotiated with Motivation Systems, 
Inc. The project will be designed to determine the feasibility of 
using the system for each of two functions; (a) to enable individual 
classroom teachers to manage pupil learning activities in reading so 
that the maximum achievement accrues; and (b) to provide an asses^ent 
system idiich will facilitate communication between classroom teachers 
and other segments of society relative to pupil progress in reading. 
The total amount of the contract is $475,000. This project is a 
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2.2.0Z 



2.2.03 



2.2.04 



2.2.05 



2.2.06 



cooperative effort between adiilt education, migrant education and the 
research and development program. 

A second contract has been negotiated with Florida State Uhiversit>’" to 
audit the results of the feasibility study. 

Design Training Program for Community School Directors 
Contract: Florida Atlantic University $ 42,082.00 

A contract has been negotiated with Florida Atlantic University for 
the designing of training procedures and the selection of materials 
for the training of community school directors. A major fociis of the 
training program development will be the production of a series of edu- 
cational experiences which will efficiently and effectively assist in- 
service and preservice directors with achieving the goals of community 
education. 



Reviewing Performance Contracting 

Performance Contracting arrangements in Florida and elsewhere will 
be revie^^fed. Recommendations for making effective use of performance 
contracting as a strategy to improve Florida education will be pro- 
posed. It is anticipated that no funds from the R 5 U allocation 
will be required for this project. 

Individualized Instruction Model 

Contract: Florida State University (Estimatedj $100,000.00 

This project will be conducted in cooperation X'/ith a school district to 
develop and demonstrate an optimized system of individualized 
elementary instruction for a "model" public school. The project 
will take advantage of the most ^^fell -developed and promising materials, 
techniques, and procedures available throughout the nation. It will 
be designed as a demonstration for Florida schools and Florida educa- 
tors, and will include elements which can be readily disseminated to 
other schools throughout the State. It is expected that the project 
will span a three-year period and will receive financial support 
from various sources. The final specifications for this project 
were not complete at the time of this report. 



Student Participation in Instruction 

Planning Contract: Florida Education Association $ 3,000.00 

Contract; Florida Education Association (Estimated) 20,500.00 
Techniques teachers use to involve students in instruction will be 
identified and training materials will be designed for instructing 
teachers and students in using selected techniques. The planning 
contract for this project is complete; however, the production con- 
tract had not been finalized at the time of this report. 
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Extended School Year 



2.3 



3.0 

3.1 

3.1.01 



3.2 

3.2.01 



3.3 



3.3.01 



3.3.02 



3.4 

3.4.01 



Teacher Education 

Contracts: (contractor not yet determined) (Estimated) $134,200.00 
\ comprehensive plan for strengthening the training, evaluation and 
licensure of educational personnel has been developed. It will be 
supported, with Educational Research and Development funds, supplemented 
with fuiids from other sources. The plan includes the following four 
components: (a) develonment of a comn rehens ive catalog of competencies 

for teachers and administrators, (b) research on the relationship be- 
tv^reen teaching competencies and pupil achievement, (c) identification 
or production of training materials, and (d) assistance to institu- 
tions and school districts with staff development for teacher training 
personnel , 

Projects for program development and management 
Advisory Council 

Amount $11,740.00 

The members of the Advisory Council are appointed annually by the 
Commissioner of Education. The 24 members renresent professional 
educators, lay people interested in education, and students. There 
will be five meetings of the Advisory Council during the 1971 year 
at an approximate cost of $2,348 per meeting for travel and per 
diem. The total cost of the Advisory Council meetings this year 
will be approximately $11,740. 

Board of Governors 



Amount $27,303.00 

The Board of Governors consists of eight nationally recognized leaders 
in education. Funds are budgeted for seven meetings. Board members 
receive expenses plus an honorarium for each meeting. 

Internal Operation 

Postage and Multilithing 

Amount ^ 4,300.00 

$4,300 has been allocated for postage and multilithing directly re- 
lated to the operation of the Research and Development Program. 

Costs for salaries, department travel, supplies, building rental, 
office equipment, etc., are supported from the regular operational 
budget of the Division of Elementary and Secondary Education. 

External Support 

Dissemination of Information 

Contract: Franceschi Advertising, Inc. $ 2,500.00 
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Franceschi Advertising, Inc., has been employed to produce two 
folders to describe Florida’s R § D Program and to produce a 
slide'tape presentation idiich 1^^11 be used to acquaint the general 
public with the program. 

Determine Readability Level 

Contract: Professional Reading Techniques, Inc. $ 1,250.00 

A contract has been negotiated to determine readability level of 100 
state adopted textbooks. The texts have been identified by curriculum 
consultants in the Department. Additional costs for this service will 
be from other sources within the Department. The total contract is 
$2,650.00. 

Technical Assistance in Development of Criterion-Referenced Test 
Exercises 

Contract: Florida Board of Regents $54,892.00 

Technical assistance for the development of criterion-referenced 
measures and procedures will be sttpported through Florida State 
University, Florida A ^ M University, University of South Florida, 
and Florida Atlantic University. This cissistance and coordination 
will be offered to all contractors producing assessment instruments 
and procedures for the R § D Program. Ihis measure was instigated 
to insure quality and compatibility among products. 
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